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Abstract. The excursion set model provides a convenient theoretical framework to derive dark matter halo abun- 
dances. This paper generalizes the model by introducing a more realistic merging and collapse process. A new 
parameter regulates the influence of the environment and thus the coherence (non-Markovianity) of the merging 
and the collapse of individual mass shells. The model mass function also includes the effects of an ellipsoidal 
collapse. Analytic approximations of the halo mass function are derived for scale-invariant power spectra with the 
slopes n = 0, — 1, —2. The n = —2 mass function can be compared with the results obtained from the 'Hubble 
volume' simulations. A significant detection of non-Markovian effects is found for an assumed accuracy of the 
simulated mass function of 10%. 
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1. Introduction 

The hierarchical growth of virialized cosmic structures 
provides a useful physical paradigm for the understand- 
ing of the formation of galaxies and clusters of galaxies in 
the Universe (White & Rees 1978). The Zel'dovich (1970) 
theory also includes a description of partially virialized 
structures like filaments and walls. In both models, cos- 
mic structures grow from initial Gaussian density fluctu- 
ations via gravitational instability, leading after merging 
and their (partial) virialization to mass functions which 
are used as powerful statistical diagnostics. 

Theoretical mass functions of dark matter halos are 
estimated from N-body simulations with accuracies of 10- 
30% (e.g. Jenkins et al. 2001). More physical insights 
can be obtained from analytic treatments based on Press- 
Schechter (PS) -like arguments (Press & Schechter 1974; 
Bond et al. 1991, hereafter BCEK). Alternative deriva- 
tions are based on, e.g., non-Gaussian statistics (Lucchin 
& Matarrrese 1988), or treat both fluctuations and in- 
teractions of density perturbations within one process 
(Cavaliere & Menci 1994), or directly consider the non- 
linear regime (Valageas & Schaeffer 1997). The inclusion 
of non-spherical dynamical approximations (Monaco 1995, 
Lee & Shandarin 1998) and ellipsoidal collapse models 
(Sheth, Mo & Tormen 2001, hereafter SMT, 2002) modify 
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the assumption of a spherical collapse while preserving the 
simplicity of the original excursion set idea. 

The excursion set model of BCEK assumes a Gaussian 
density field which is smoothed at a given spatial location 
with a top-hat filter in wavenumber space (sharp fc-space 
filter) using different comoving filter radii R. The result- 
ing filtered density contrasts S(R) perform a highly jagged 
diffusion trajectory (Fig.QJ where the mass function is de- 
rived - as a function of the standard deviation a(R) of the 
mass density fluctuations - from the loss rate of trajecto- 
ries at the barrier 5 C at their lowest a level (highest R or 
mass scale). For the spherical collapse model and for the 
Einstein-de Sitter Universe we have S c — 1.686, weakly 
dependent on cosmology. The halo mass function is thus 
directly related to the first passage time distribution of 
the trajectories. 

There is a problem with this approach related to the 
assumption of a sharp fc-space filter. The filter gives a 
quite unrealistic mass assignment scheme, with a growth 
of cosmic structure which depends only on the mass of 
a halo it has within an infinitcsimally small time inter- 
val at a given cosmic epoch, and without any dependency 
on past or future properties of the halo (Markov assump- 
tion). Therefore, the merging events occur as completely 
uncorrelated, sudden, jumps in the formation history. We 
will replace the sharp fc-space filter by a non-sharp filter. 
This leads to a more realistic mass assignment scheme. 
The corresponding growth of cosmic structure depends on 
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the properties of the halo over a finite and future-directed 
time range (non-Markov assumption). 

The idea to invoke non-Markovian processes is not 
new. A discussion of the physical consequences of the 
Markov assumption and why related processes could fail 
can be found in White (1996, 1997). BCEK pointed out 
the relation between the shape of a mass filter and the 
Markov assumption. Their discussion of non-Markovian 
processes is, however, mainly restricted to results obtained 
with Monte-Carlo experiments. 

Using the traditional excursion set model as a guide- 
line, Sect. |21 introduces a simple analytic model which de- 
scribes a more uniform mass assignment scheme, and thus 
a more uniform spherical collapse of dark matter halos. 
This model is further improved in Sect.|31 by including 
the effects of an ellipsodial collapse similar to SMT. The 
combined model can be regarded as a simple though typ- 
ical example of a non-Markovian process. It generalizes 
the traditional excursion set model in a manner such that 
non-Markovianity can now be gradually increased by a 
new filter parameter. The same filter parameter also in- 
creases the smoothness of the profile of the mass filter (see 
Eq.Elin Sect.©. 

The standard mirror image method is used in Sect.|S] 
to derive an analytic form for the halo mass function. We 
show why this method, which in general does not work 
for non-Markovian processes, can be used in our specific 
case. The resulting mass function has the same functional 
form as the standard excursion set result in terms of the 
variance of the mass distribution and the critical density 
threshold. However, non-Markovian effects change the re- 
lations between filter radius, mass and variance. These re- 
lations become a function of the power spectrum of the un- 
derlying mass distribution. After the corresponding trans- 
formations of the mass functions they also become appar- 
ent in the halo mass function itself. This is the reason why 
in our non-Markovian context, the profile of the mass filter 
and thus how much mass is sweeped in from the surround- 
ing mass of a collapsing region becomes a function of the 
power spectrum. 

How much mass the filter sweeps in for a given filter 
radius can be a quite complex function, especially when 
general power spectra are considered. We could derive ap- 
proximate analytic results for scale-invariant power spec- 
tra with the slopes n = 0, —1, —2. The latter case is close 
to the observed value and allows a comparison with the 
Jenkins et al. (2001) mass function obtained from the 
'Hubble Volume' simulations (Sect.EJ. The basic aim is 
to test under the given assumptions the presence of non- 
Markovian effects in the simulations and to determine how 
accurately mass functions should be measured to detect 
the effects. A discussion of general power spectra goes be- 
yond the scope of our analytic treatment and is postponed 
to a further paper. 
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Fig. 1. Trajectories for the extended PS process (Markovian 
process, jagged curves, T = 0) and for the non-Markovian pro- 
cess (smooth curves, T = 0.23). 



2. Spherical collapse and merger trajectories 

The Markov assumption corresponds to an oscillating fil- 
ter in configuration space or a sharp filter in fc-space. For 
the determination of the total collapsed mass of a halo, the 
formal weighting of each mass shell with an oscillating fil- 
ter suggests the following collapse picture. The innermost 
mass shell located around a peak in the cosmic mass distri- 
bution (though not necessarily around a massive particle) 
is up-weighted in the mass budget and is thus expected to 
collapse, whereas the next overlaying mass shell located 
around the first minimum of the filter is down-weighted, 
the following mass shell is up-weighted again, and so on. 
Similarily, for the determination of merger trajectories, 
the sharpness of the filter in fc-space leads to the addition 
of statistically independent fluctuation power in disjunct 
fc-shells and thus to highly jagged trajectories with com- 
pletely independent increments. Both the collapse and the 
merger trajectories are regard as unrealistic (Fig.^l. 

BCEK showed that a smooth, non-oscillating filter can 
be obtained with a non-Markovian process. It is also well- 
known that smooth filters like a Gaussian or a standard 
top-hat are consistent with the uniform (coherent) col- 
lapse of all concentric mass shells. Moreover, the smooth- 
ness of the filter in fc-space mixes fluctuation power located 
in disjunct fc-shells and thus smoothes the merger trajec- 
tories. We are thus searching for diffusion processes with 
smooth merger trajectories. The physical significance of 
the corresponding mass filter is evaluated by the compari- 
son with mass functions derived from simulations (Sect-JSJ) . 

Formally, the merger trajectories of the excursion set 
model are described by the Wiener stochastic diffusion 
process W(t) - the Brownian motion. We follow the gen- 
eral convention and work with a pseudo time or mass 
resolution variable t(R) in a(t) which will be specified 
later (Eq.|5Jl, and the filtered density contrast 5(a) (see 
BCEK and Lacey & Coles 1993 for more details). A non- 
Markovian process with the desired properties has the in- 
crements of the density contrast 



dS(t) 



l dW(s) 



dt. 
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Fig. 2. Filter profiles Wr{k) as a function of comoving wavenumber k in units of [ft Mpc 1 ] for three values of the T parameter 
(left: T = 0.00, middle: T = 0.23, right: T = 0.50). Each panel shows two groups of filters. Left group: filter radius R = 8 h' 1 Mpc, 
right group: R — 3 ft -1 Mpc. Each group consists of three filter curves. From up to down: n = (continuous), —1 (dotted) ,—2 
(dashed). The normalization of the power spectrum Po is adjusted to give cr$ = 0.9 (at T = 0). 



The increments depend on all values of W(t) within [0, t], 
and if the parameter T tends to zero, the smoothness of 
the merger trajectories deminishes (Fig.[Q. Whereas the 
sum over history is in most cases a generic feature of non- 
Markovian processes, the kernel function in Eq. Q may 
not necessarily be exponential. However, its explicit form 
comes from the shape of the mass filter function (Eq.|HJ 
and finds its justification through the usuability of this 
mass filter. Its shape suggests more realistic extraction of 
the material which will ultimately end up in a spherical 
collapse to form a virialized halo. The new parameter T 
measures the coherence (non-Markovianity) of the collaps- 
ing mass shells and can be estimated from fits of halo mass 
functions to simulated or observed data (Sect.fBJ. 

3. Ellipsoidal collapse and non-Markovianity 

The theory of ellipsoidal collapse (Bond & Myers 1996, 
SMT) provides a relation between the critical density con- 
trast of an ellipsoidal collapse S ec and a spherical collapse 
S c of the form <5 oc = S c + j38 c {a / 8 C ) 21 . For convenience 
we set 7=1, yielding mathematically exact first passage 
time distributions. Our approximation 



P 2 



(2) 



deviates from the exact result on the 10 % level or better 
for (3 — 0.3 within 0.0 < a 2 < 1.5. In the diffusion model of 
merger trajectories, the ellipsoidal collapse (Eq.|5J induces 
a linear drift superposed onto the diffusion process (Eq.[TJ 
where high (low) mass objects needs low (high) effective 
critical density contrasts for their virialization. We thus 
rewrite Eq. Q as 



d6(t) 



l dW{s) 



dt-(3da 2 (t) 



= ^ { W(t) - [6(t) - E(*(t))] } dt - |var(«5(i)) dt , 

<y(o) = o, (3) 

where T and /3 are fixed positive numbers. The solution 
of Eq. © can be represented as 



5(t)= (l-e-^)dW(s)- /3a 2 {t), 



(4) 



with the expectation E(S(t)) — —f3a 2 (t) and the variance 
t 

<j 2 {t) = Var(«5(t)) = J(l - e-T 4 ) 2 ds 
o 

= t- |r + 2Te-* - ^e-# . (5) 



For some applications (Eas . 11 2114116( 1 it is convenient 
to have the inverse of Eq. JSJ • A good approximation is 



t{a 2 ) = a 2 (t) + 1.98 T { 1 - e 



(6) 



which has an accuracy of better than 2% for a < 1 and 
< T < 5. 

The smoothness (differentiability) of the sample 
trajectories (Fig.^l is a clear signature of the non- 
Markovianity of the process (Eq.|3J|. A general discussion 
of non-Markovianity can be found in Feller (1968). As 
mentioned above, a non-Markovian process can be ob- 
tained by integrating certain Markov processes. It is well- 
known from diffusion theory that if one starts with the 
Markov process V(t) representing particle velocities in a 
viscid medium, then positions X(t) defined as dX(t) = 
V(t)dt form the simplest non-Markovian process. Note 
that setting a complete path X(s), t — T < s < t, is 
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not the same as setting only one position X(t) which pro- 
vides the non-Markov property of X{t). In our case, the 
process S(t) can be represented as an integral over the 
Ornstein-Uhlenbeck process (see Sect.|SJ) and is thus non- 
Markovian. Moreover, the 8(t) are Gaussian and have a 
probability distribution which is similar to the probabil- 
ity distribution of W(t) — (3t. 

4. Filter function 

The mass filter of the non-Markovian process can be de- 
rived as in Schuecker et al. (2001a) by equating the process 
variance (Eq.[5l and the variance of the underlying matter 
fluctuations, 



ds 



(i- e -y 



Airk 2 dkP(k) 
(2^)3 



where P(k) is the matter power spectrum, Wr{kR) the 
mass filter function in fc-space, and R the filter scale in 
configuration space. Eq. J7J) cannot be solved easily for an 
arbitrary P(k). However, for scale-invariant power spectra 
of the form P(k) = P Q k n the filter 

W T (kR) = l~-~< P ° ^ {kRr+3 



-exp 



1 



T 



(8) 



27r 2 (n + 3)i? n + 3 

for kR < 1, and Wr(fc-R) = elsewhere, is consistent with 
Eq. (JSJ when the resolution variable is defined as 

t = ^ (Q) 

27r 2 (n + 3)i?"+ 3 ' { > 

Here, t is the same as in the Markov excursion set model 
and requires n > — 3 for structure to grow through hier- 
archical clustering. 

A new aspect is the dependence (for T > 0) of the 
filter on the power spectrum (Fig.|3Jl. For standard filters, 
the profile does not change with P(k) and only normal- 
ization factors like the characteristic mass-scale M* used 
to get convenient invariance properties of the halo mass 
function depend on P(k). In the present case the filter 
profile depends on P{k) and thus on the spatial correla- 
tion function. The correlation function approximates the 
mean shape of density peaks. Therefore, the profile of the 
filter roughly follows the mean profile of density peaks. 

4.1. Filter volumes 

From the volume Vt of the filter we can estimate the 
mass M = pVr extracted by the filter from the mean 
cosmic matter density p. The volume Vr(R) is related to 
the Fourier transform of Eq. JSJ by 



MR) =WT(r = ' R) = ^ 



1/R 



dkk 2 W T (kR). (10) 



For the filter (Eq.[81), three cases can be studied in a 
straightforward manner. For a power spectrum with the 
spectral index n — we have 

1 1 T / fo \ . , 

= ( 1 - e'e^TRi . (11) 

V T 6ir 2 R 3 Pq V J ' K ' 



P = 3072tt 2 



at + 1.98 T 1 



Mpc 3 . (12) 



For n = — 1 integration of Eq. i|10fl yields 
1 




al + 1.98 T { 1 - 



P a = 256n A 



For n = — 2 integration of Eq. i|10fl yields 



(13) 



Mpc 2 . (14) 



1 



\W T (kR)\' , (7) — = 



1 



T 4tt 2 T 2 8tt 4 T 3 



V t 6tt 2 R 3 P R 2 PqR P n 3 



P a = 16n 2 



1.98T 1 - e- ( ^)° 



(l-e-drfe) ,(15) 



Mpc, (16) 



where Eqs. (|12I14I16() use the approximation (Eq.[()J), and 

us is a parameter determined by the filter (Eq.[HJ anal- 
ogous to the standard normalization of the power spec- 
trum. In Eq. Ijl3(l . erfi is the imaginary error function. In 
all three cases, for a given radius the volume and thus the 
mass covered by a filter with T > is larger compared to 
T = where we have Vo = 6tt 2 R 3 . 

4.2. Filter radius-mass relations 

For the mass function, the relation between the filter ra- 
dius and mass are needed. Therefore, Eqs. 5|> have 
to be solved for R. For n = we have 



R(M) 



M 1 / 3 



{6tt 



W{z)}) 



1/3 



(17) 



cx p(l + m) ' 



with W(z) the principal branch of the Lambert W- 
function (e.g. Corless et al. 1996, not to be confused with 
the Wiener process in Eq.[3J|. In the present case we have 
oo > T > which corresponds to the range — l/e<z<0 
where VF(z) is monotonically increasing with values in the 
interval —1 < W(z) < 0. In some cases (Ea . 123(1 the deriva- 
tive dW{z)/dz = W/[z(l + W)} is needed. 

For n = — 1 we can neglect the final exponential term 
in Eq. (JTSJl which has an effect of < 5% for T < 1 up to 
halo masses of 10 16 M Q . Solving the truncated equation 
for R yields 



R(M) 



u 4 



U 5 , (18) 



(Ui + 3VE/2) 1 / 3 

where the functions Ui . . . U5 are given in Appendix lAl 
(Eqs .EH etc.). 

For the case n — — 2 the final exponential term in 
Eq. ijT5|l can be neglected which has an effect of < 5% for 
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Fig. 3. Mass functions f(M) for Gaussian fluctuation fields with a power spectrum with n — 0, — 1, —2. Mass M in solar units: 
T = 0, /3 = (dashed lines), and T = 0.23, (3 = (continuous lines). The computations assume the normalized cosmic mass 
density £l m — 0.27, the standard normalization erg = 0.9 and the normalized Hubble constant h = 0.7. 
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Fig. 4. Mass functions f(M) for Gaussian fluctuation fields 
with a power spectrum with n = —2.0. Mass M in solar units. 
T = 0, (5 = (dashed line), and T = 0.23, j3 = 0.12 (continuous 
line). Further normalizations as in Fig.|3] 

T < 5 up to halo masses of 10 16 M . Note that Eq. JTSJl 
without the exponential term can also be obtained by 
asymptotic expansion of Eq. i|10fl , which is important for 
generalizing the present discussion to other power spectra. 
Solving the truncated equation for R yields the radius- 
mass relation 



R(M) = 



SlS. 



1/3 



S3 — 54 S 2 



1/3 



(19) 



where the functions Si . . . S5 are given in Appendix lAl 
(Eqs.EHetc). 

5. Halo mass function 

We define the halo mass function n(M) = f(M)p/M as 
the number of dark matter halos per unit volume and 
mass. As first shown in BCEK, the fraction f(M) may be 
obtained from the first passage time distribution function 
of the assumed diffusion process. 



Let r be a random variable which determines the first 
passage time when S(t) achieves the critical value 5 C . 
Taking into account that S(t) £ Af(-/3a 2 (t),cr 2 (t)), let 
us define the process A(t) obtained by replacing the ori- 
gin to 2S C such that A(t) £ N(25 c - f3a 2 (t) , cr 2 (i)) . Both 
processes are Gaussian. Calculating the probabilities p(t) 
and P{t) of the trajectories of S(t) and A(t) which attain 
the level S c at the same moment t, we obtain 

p(t) = P{t) exp(-25 c /3) . (20) 

The set of trajectories of S(s), < s < t, with asymptotic 
end points S(t) £ (—00, S c ) which attain the level S c at the 
time r, r < t can be associated with the set of trajecto- 
ries of A(s), < s < t, which have the asymptotic end 
points A(t) £ (— 00, 5 C ). In fact, by means of the inclu- 
sion A(t) £ (—00, S c ) it follows that there exists the time 
r, r < t, such that A(i) = S c . The Eq. implies that 

t . 

dS(t) = V(t)dt - f3da 2 (t), where V{t) = i / e'-dW(s) 



is the Ornstein-Uhlenbeck process. Hence, increments of 
the processes S(t) and A(t) are driven by the Markov pro- 
cess V(t). This means that given a trajectory of 8(t), which 
goes through the point 8 C at the moment t = r, there ex- 
ists the trajectory of A(t) which coincides with the tra- 
jectory of S(t) for t > t. The Markov property of V(t) 
guarantees a possibility to construct this trajectory. It is 
thus sufficient to give A(t) the same values of the driving 
Ornstein-Uhlenbeck process V(t) as 5(t) for t > r. On the 
other hand, the probability of trajectories S(t) and A(t) 
which achieve the level 5 C at the same moment r are con- 
nected by the Eq. (|2C)|> . Hence, the relation (|20|l implies 

P(S(t) < S c I S(t) =S c ,r<t) = e- 2S ^P(A(t) < S c ) , 

so that 

F(t) = P{t >t) = P(S{t) < S c ) - P(5(t) <S c \t <t) = 



1 



exp 



2a 2 (t) 



d.r 
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Fig. 5. Best fit mass function f(M) with T = 0.23, /3 = 0.12 
(continuous line) and the transformed mass function of Jenkins 
et al. (2001) with 20% Gaussian random errors (dots with error 
bars). Normalizations as in Fig.0 



exp(-2<5 c/ 3) J exp 



(x-26 c + f3a 2 (t)) 2 



2a 2 (i) 



dx 



dt 



For the normalized loss rate of trajectories, f(t) = — dFi ^) 
we obtain the density 

1 S r 



f(t)dt 



= f(<J 2 )da 2 . 



exp 



(3a 2 (t)f 



2a 2 (t) 



da 2 



(21) 



Written in this form, the theoretical mass function shows 
no dependency on T and reproduces for f3 = the pre- 
diction of the Markovian excursion set model. However, 
cr 2 (i), which is basically a function of mass, depends on T 
(see Eq.^J so that the non-Markovianity becomes appar- 
ent after the transformation of Eq. H21|l into 



f(M) = f(a 2 (M)) 



da 2 (M) 



dM 



Unfortunately, the final formulae of the form 
da 2 {R) dR(M) 



f(M) = f(a 2 (R(M))) 



dR 



dM 



(22) 



(23) 



become quite clumsy after the insertion of all relevant 
equations (see Appendix ^J. 

6. Discussion of results 

The process (Eq.0J corresponds to a smooth filter profile 
and allows a simple discussion of non-Markovian effects 
within the excursion set model. The model includes the 
standard excursion set result as a limiting case, and allows 
non-Markovian effects to be increased gradually by the 
new filter parameter T. 



6.1. Effects of non-Markovianity 

Figure |3] shows halo mass functions f(M) for different 
power spectra and values of the T parameter. In all cases 
the non-Markovian effects described by Eq. (J3J increase 
(decrease) the number density of high (low) mass halos. At 
high masses the ellipsoidality slightly decreases the num- 
ber density of high mass halos and thus partially com- 
pensates non-Markovianity. At small masses both non- 
Markovianity and ellipsoidality decrease the number den- 
sity (Fig.EJ). 

The result of equating the mass and the process vari- 
ances in Eq. JJJ) is a mass filter with a profile which de- 
pends on the power spectrum of the mass distribution and 
thus on the mean profile of density peaks. To show that 
this is a generic property of non-Markovian processes with 
increments determined by integrals of the form (Eq.rj), we 



generalize the [1 - 



-(t-s)/T] 



K T (s, t) so that Eq. (0 reads 



term in Eq. Q by a function 



t = 



[ dsK^{s,t) 
Jo 



4irk 2 dkP(k) 



|^ T (A:i?)| 2 .(24) 



Moreover, from the derivation which leads to Eq. J^J 
we found that the resolution variable t is the same for 
the Brownian process and our non-Markovian process. 
The same resolution variable was also obtained for the 
Ornstcin-Uhlenbeck process (Schuecker et al. 2001a). We 
thus generalize Eq. 10 to a universal resolution variable 



t = 



f 1/R 4nk 2 dkP(k) 
ds = I ——L± = 8 [R ) p(k)]. (25) 



ii 



ii 



(27T) 



The combination of Eqs. I|24(l and (|25|l then suggests the 
equivalence Kt(R, P(k)) = Wr{kR) for kR < 1 and zero 
elsewhere. This shows that the kernel of Eq. © which de- 
termines the increments of the process is closely related 
to the profile of the mass filter. 

We further conclude that for merging and accretion 
processes described by the comparatively simple integra- 
tion scheme (Eq.|2|), the mass filter and thus how much 
mass is sweeped in from the surrounding mass by a col- 
lapsing region must also depend on the global mass dis- 
tribution, and thus on the power spectrum. 

Equations (|10I19|) follow a "natural" choice of the re- 
lation between the filter radius, used in the process of halo 
detection, and the halo mass as determined by the mate- 
rial which eventually collapse to form a virialized struc- 
ture. However, other choices are also possible (BCEK) and 
still a matter of debate. 

We further note that the application of filters to all 
spatial points of a density field, as proposed in all PS-like 
models, leads to a large scatter between filter mass and 
group mass. The introduction of non-Markovianity follows 
the same local filtering scheme and is thus not expected to 
significantly reduce the scatter on the halo-by-halo level. 
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Fig. 6. x 2 distribution (1 — 3a contours for three parameters) for the spectral index n = —2 obtained from the comparison 
of mass functions f(M) with different T and /3 parameter values and the transformed Jenkins et al. (2001) mass function. 
Normalizations as in Fig.El The x 2 test assumes errors of 30% (left), 20% (middle), 10% (right) of the Jenkins et al. mass 
function. 



6.2. Comparison with simulated mass functions 

On the statistical level, PS-like models predict mass func- 
tions, merger rates, formation times, biasing schemes 
etc. remarkably accurately. A comparison of the theoret- 
ical mass functions (Ea. l23[l with the results from large 
and high-resolution N-body simulations (e.g., Jenkins et 
al. 2001) should thus be more fruitful and should give 
more important information about the significance of non- 
Markovian effects. 

The Jenkins et al. (2001) mass function can be used 
for fluctuation fields with effective power spectrum slopes 
between n e ff = —2.5 and —1 at a = 0.5 in the mass range 
10 11 — 10 16 Mq. Observations suggest a slope of about n = 
—2.0 (see, e.g., Schuecker et al. 2001b who found n = —1.8 
on scales < 100/i _1 Mpc for X-ray clusters of galaxies - 
quite consistent with the power spectrum of galaxies, see 
their Fig. 16). We thus compare with our n = —2 model. 

To be consistent with our "natural" choice of the 
radius-mass relation (Ea. ll9|) , the Jenkins et al. mass func- 
tion (e.g. their Eq. 9) has to be transformed accordingly by 
using the <j 2 (R(M)) relation of the non-Markovian process 
for n = — 2. To say it in another way, the non-Markovian 
effects of the process (Eq.^J can only become apparent af- 
ter the transformation of f(a 2 (R)) to f(M) because non- 
Markovianity changes the radius-mass assignment scheme. 
Therefore, when we want to search for non-Markovian ef- 
fects we have to transform f(a 2 ) of both the theoretical 
and the simulated mass function and test different val- 
ues of T. For this test we multiply the prefactor 167T 2 in 
the normalization (Ea. llfijl by 1.234 to be consistent with 
the standard a& normalization (obtained with the top-hat 
filter) for T = 0. 

The comparison with the Jenkins et al. (2001) mass 
function within the mass range 10 12 — 10 16 Mq (for the 
lower limit see Sect. 16. 3| gives the best fit parameter val- 
ues T = 0.23 and /3 = 0.12 with x 2 = 1.4 for three degrees 
of freedom (Fig. EJ. The statistical significance of the non- 
Markovian effects strongly depends on the assumed error 
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Fig. 7. \ 2 distribution (1 — 3<r contours for three parameters) 
in the (3 = 0.12 plane, assuming 10% errors of the Jenkins ct 
al. (2001) mass function. 

of the Jenkins et al. mass function. For errors of 20-30%, 
non-Markovian effects must be regarded as insignificant, 
whereas for 10% errors, non-Markovianity is clearly de- 
tected (Fig.EJ). We thus conclude that for the most opti- 
mistic error estimates of the Jenkins et al. mass function, 
its shape suggests the presence of non-Markovian effects, 
i.e., effects of the environment on the coherence of the 
collapse. Moreover, non-Markovian effects seem to be not 
very large and cosmic mass functions with errors better 
than 10% are needed for their clear detection. 

It should be mentioned that we simultaneously tested 
in Fig.|S| for the significance of the scaling parameter a 
introduced by SMT to account for a failure of the sim- 
ple counting argument of the excursion set formalism (R. 
Sheth, private communication). The best fit has a — 0.99 
(Fig. [3) which means that the inclusion of non-Markovian 
effects does not require this correction. Therefore, the like- 
lihood contours in Fig.[S] are only plotted in the a = 1 
plane. 
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6.3. Effects of ellipsoidality 

The effects of ellipsoidality on the halo mass function are 
in general much larger and are detected for all random 
errors < 30% with clear significance. The best fit j3 = 
0.12 is lower than = 0.3 obtained from simulations (see 
Sect.|2J). In addition, the model starts to deviate from the 
Jenkins et al. function at masses smaller than 10 12 M Q . In 
order to understand these failures of the model one should 
not forget that our goal to give a full analytic treatment 
of the problem forces us to approximate the ellipsoidal 
collapse by a linear drift. Sheth & Tormen (2002) give a 
simple prescription for approximating the solution to the 
general barrier in the Markov case which better fits the 
low-mass range. Therefore, a useful direction for future 
work is to see if their method works in our particular non- 
Markovian context also. 

Future observed mass functions from e.g. X-ray clus- 
ters of galaxies and lensing studies have high enough preci- 
sion for detailed studies of non-Markovian effects expected 
in the high-mass regime. On the theoretical side, further 
studies are in preparation to predict mass functions also 
for Cold Dark Matter power spectra to improve the com- 
parison with observed and simulated mass functions. 
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Appendix A: Computation of mass functions 

A summary is given of the equations used for the compu- 
tation of the dark matter halo mass functions discussed in 
the main text. The meaning of the different symbols are 
as follows. 

f(cr 2 ) dark matter mass function as a function of the 
variance er 2 of the random mass field or of the diffusion 
process. f(M) dark matter halo mass function as a func- 
tion of mass M. S c critical density threshold. j3 parameter 
regulating the ellipsoidality of the collapse ((3 = spher- 
ical collapse). T parameter regulating the coherence of 
the collapse, i.e., the deviation from Markovianity (T = 
traditional Markovian excursion set model) . Pq amplitude 
of the scale-invariant power spectrum in P(k) = Pok n 
with the spectral index n. p mean cosmic matter density. 
Q m normalized cosmic matter density, h Hubble constant 
in units of 100 kms -1 Mpc -1 . t pseudo diffusion time or 
mass resolution variable. R filter radius. W(z) the princi- 
ple branch of the Lambert W- function. U\ . . . U5, S\...S$ 
auxiliary functions, and U[. . . t/5, S[ . . . S5 their deriva- 
tives with respect to M. 

The mass functions /(<r 2 ) with the spectral indices n = 
0, — 1, —2 have the same form 



/2tt a* 



and the same <J 2 {t) dependence 

o 2 = t - ~T + 2Te-*/ T - -e- 2t ' T . 
2 2 

Moreover, the cosmic mass density 
p = 2.7755 Q m h 2 10 11 M Mpc" 3 
is the same for the power spectra. 



(A.l) 



(A.2) 



(A.3) 



A.l. Mass function for a power spectrum with the 
spectral index n = 



Dark matter halo mass function: 

da 2 (R 3 ) dR 3 (M) 



f(M) = f{a 2 {R\M))) 



dR 3 



dM 



Pseudo diffusion time or mass resolution variable: 
6tt 2 i?3 

Filter radius-mass relation: 
M 



R" 



6w 2 p 



6k 2 TM 



[1 + W(z)] 



(A.4) 

(A.5) 
(A.6) 
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Normalization of the matter power spectrum 

-(a 2 a /T) - 363 



1 



P = 3072tt 2 |er| + 1.98T 
Argument of the Lambert W function. 

z = — exp 



} (A.7) 



MT J 



(A. 



Gradient of filter radius with mass: 
dR 3 1 

~d~M 



6tt 2 TM 



6ir 2 p 

p m {r [i + w{z)\ 



[1 + W{z)] 



pPg W(z) 
eM 1+W(z) 



6tt 2 {pP n + TM [1 + W{z)]Y 
Gradient of mass variance with filter radius: 
da 2 (R 3 ) _ P f, St. 



(A.9) 



dR3 6 ^ 6 (l-2e-^ + e-^) (A.10) 

More information about the Lambert W function can be 
found in Corless et al. (1996). 



A. 2. Mass function for a power spectrum with the 
spectral index n = —I 



Dark matter halo mass function: 

da 2 {R) dR(M) 



f(M) = f(* 2 (R(M))) 



dR 



dM 



Pseudo diffusion time or mass resolution variable: 
Po 



t 



4tt 2 R? 

Filter radius-mass relation: 



(A.12) 



R(M) 



U 5 (A.13) 



Auxiliary functions for the computation of radius-mass 
relation: 



Ui = 9tt 4 p 2 P$M - 4tt 6 M 3 T 3 

U 2 = 9tt 8 p 4 P$M 2 - 8tt w p 2 P$M 4 T 3 

U 3 = 3 • 2 2/3 7r 2 pP 

2 2/3^2 M 2 T 2 



Ua = 



Ua = 



3pP 



MT 



(A.14) 
(A.15) 
(A.16) 

(A.17) 
(A.18) 



Normalization of the matter power spectrum: 



al + 1.98T ( 1 - e"^ 



P = 256tt 2 

Gradient of filter radius with mass: 
dR(M) _ U[ 



Mpc 2 (A.19) 



2 U 2 



dM 3U 3 (U! + 3VC^) 2/3 {Ui + 3V^) 1/3 
Ua(U{^-, , 



%u^ l2 u> 2 ) 



3(Z7i + 3VF2) 4 / 3 



UL 



(A.20) 



Derivatives of auxiliary functions with respect to mass: 
U[ = 9tt 4 p 2 P 3 - 12tt 6 M 2 T 3 (A.21) 
U' 2 = 18w 8 p i P^M -32tt w p 2 P^M 3 T 3 (A.22) 

U' A = — (A.23) 



3pP 



UL 



T 



(A.24) 



Gradient of mass variance with filter radius: 

da 2 (R) Pn / p a p a \ 

The determination of the radius-mass relation neglects the 
exponential term in Eq. (|13|l . 

A. 3. Mass function for a power spectrum with the 
spectral index n = —2 



Dark matter halo mass function 



dR 



dM 



Pseudo diffusion time or mass resolution variable: 

t = -*L- 
2tt 2 P 

Filter radius-mass relation: 



(A.ll) R(M) 



Si s 



1/3 



s. 



S4. 5*2 



-1/3 



(A.26) 
(A.27) 
(A.28) 



Auxiliary functions for the computation of the radius-mass 
relation: 



Si 

5*2 



5:, 
Sa 

S 5 



6(2^ 4 ) 1 / 3 

P 3 M [9p 2 P 6 + 727r 4 pF 3 MT 3 + 
256tt 8 M 2 T 6 + 3(pP 3 + 8tt 4 MT 3 ) x 

9p 2 P$ + 48tt 4 p~Pq MT 3 + 128tt 8 M 2 T 6 } 
487r 4 P MT 2 

12 • 2 2/3 7r 8/3 P 2 MT(3pP 3 + 8n 4 MT 3 ) 
36(7r 2 pP 3 + 8tt 6 MT 3 ) 



(A.29) 



(A.30) 

(A.31) 
(A.32) 
(A.33) 



Normalization of the matter power spectrum: 



Po = 16vr 2 



4 



1.98T 1 - e 



Mpc (A.34) 



Gradient of filter radius with mass 
dR{M) 



1 Q Q — 2/3 Ql 1 0/ Ql q— 1/3 



2" s^s^ 



A/3 SL 



dM 



S 5 

(S1S2 + S3 — S4S2 1 ^ 3 )S' 5 
^2 



(A.35) 



Derivatives of auxiliary functions with respect to mass: 
S' 2 = 9p 2 P 9 + 1447r 4 pP 6 T 3 Af + 7687r 8 P 3 P 6 Af 2 + 

(3pP 6 + 48tt 4 P 3 P 3 M) x (A.36) 



9p 2 P 6 + AS-K 4 pP 3 MT 3 + 128tt 8 M 2 P 6 + 
(3pP 6 M + 247r 4 P 3 T 3 Af 2 )(487r 4 pP 3 T 3 + 256tt 8 MT 6 ) 
2y / 9p 2 P 6 + 487r 4 pP 3 MT 3 + 128tt 8 M 2 T 6 
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S3 = A8tt 4 P T 2 (A.37) 

S' 4 = 12 • 2 2/3 7r 8/3 P 2 T(3pP 3 + 16tt 4 MT 3 ) (A.38) 

S' 5 = 288tt 6 T 3 (A.39) 

Gradient of mass variance with filter radius: 

da 2 (R) P Q ( pq p \ ,„ , 

'l_2e"i^ 3 W +e - ^? . (A.40) 



dR 2tt 2 R 2 

The determination of the radius-mass relation neglects the 
exponential term in Eq. i|15|) . 



